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(54) SCENE RECOGNIZING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To automatically recognize 
the scene of a picture and the action intention of a 
person in the picture. 

SOLUTION: A picture processing part 12 extracts an 
object in a picture obtained by a photographing part 10. 
A recognizing part 14 decides the attribute of the 
extracted object (that is, whether or not the object is a 
person, and the action of a person when the object is a 
person, and the designation of a body when the object is 
a body). A scene recognizing part 18 selects the most 
certain scene based on the attribute of the object from 
among scene candidates. An estimating part 22 specifies 
the most matched action intention of the person from 
among the plural possible action intentions based on the 
action attribute of the person object in the recognized 
scene. 
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[mttt*a>KB] 
Si:, 

ttUi*ttfcWE^-^yx^ ha>Bi±£BK-r£ni±BM 

B«r*S/-:/BB*«£* 
[R*a2] IMiCI(0Ml:6ut, *&fc. 
x^ hrtOAKst^i^ hOBttlzft-^-cWEAlft 

mm * Birr « finan^s * **■ « z t * t -r 

[«#H 3 ] |*#Jl 2 E«<&»«lzfcl*-C. 

mJEfrSjBtt#Sl£. WfB->->BK^S-cS»**Lfc 

TAtta>fT»M*ttjrr4 c <t sw«fc-r* v— >b 

4 ] If i ~ 3 <D^-r*tj&Mz|E«(D3g«[r 

*»« t -r * >Bit^M 0 

1=1** TOES'-^atiltffiEsJ-^x^ hrtcDAIM-? 

vx^ KDBttrz*-5^ras?-r*^ts»«4:-r«*> 
[aaoBaftKH] 

[o o 0 1 ] 

i=B«rta>->->*e»B»^*ttfifizBi-r« 0 

[0 0 0 2] 

*fT#£«BLfci§^(zli-£<DSB£ 

a*i^eBLr*B«(itjL«««Mitfft«. n 

[0003] &tz. h^>T?JHS^S*|ffc» 



[0004] £t>iz. ejKDBfl-ei*. «flgftl*K«* 

[0 0 0 5] 

af*afl*BAa>«gHMinttta. ttBfc 
***t*c£3&<fcy % ttrc-ca>fRK7iTnBB«ftaR 

[0006] *^b^(4 % ±Btt«tt«(D«r-r«BBr=B 

— >£«ttWl::e»EK"e£* ££>lZ-£CDv— XZfcMf 
[O007] 

st. «£asF*Lfc«rffi^-^s;x^ KDBtt£BM-rsa 
UB»*st, mttyisjit h(7)gi4iz£-5LNrHute 

!Hft<7) >— > (BHt * >- >BHt#S tSStS^i: 
tWItti. ^zMJx* hOBttttt. JMfcMlzii*- 
:M?x* hA<A1SlT?fc*^«8ft:-efc4Ax. fir, Att 

**^iz(4^o>ifti(*ttfirA^^-t*ta)-cfey. c4xt>c7) 
ffl^*fei±izS^itTBB*<£Astt£'— >rfe«A*£B 

[ooos] iKTES/— >B«ai-cB»*lifc 

ttlz»^l*TTOEA»a>fT»*B«*«fT»BB#B£ 
$ fclzfrTSCltiT?**,, z*U=«ky % AttO>fT»* 
BIZJC C t-*tl£ * <t £ z «t pjffi t 4 o 
[0 0 0 9] «rEfrBB»*SI*, WfEv— >E«^S 

ifBAit^vi^ h0>Bttlz*»-r*fr»£»« 
U aS?Lfcff»^&H»E^-^vx^ hrt(7>^)^^-^v 

x^ Mza-^TAttoffnaBSftfi-r*. 

[oo 1 o] roE*>->B«*ai*. v~>t^^^x 

vx^ h*#-r4->— >^a«?-r«ct(cj:y v— 

BH-TS. 

[00 1 1] MBS/— >BM¥Btt. 

A<«»?H£-r£i§*lzli, ffiEv— kfft&*?zs 

[0 O 1 2] 
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[«H0>xtsa»tt] jut. mmz^^mm^m. 

[0013] ^nzi*. *mmi&m(Dmf&7Bv<7mt< 
* stir o ^mmmmomwit* mm&i o. ®<t 

SP2 2 Al/fTM)-?— £ X 2 4 £"^A^"CfSj3t£;ftTl^ 

[oo i 4] tt«an ott\ ccD*>7^-ea*j 

*U A1S£*t;lHfc£BH»-r* 0 MLfcBttBJMta 

BLtM«I«l 2i:«*LttJ:L^ Ji^SJ 1 01* 
[0 0 1 5] IBtta3|01 2 1*. A* LfcSHft 

4o »ULfc*^S?x«r HiAfttHj«:©B»S:<, ± 
[0 0 16] BSDflll 41*. tF^vx^ h^— £^<— x 

:?vx^ h££*tj£L (f>^b-K77f>^) . A 
hAUlt^vi^ h^fei<*^^v?x^ A^^ 

[£. HoTl^A^L «o-CI*£A1Sl »i£«ArtH*£ 
A«B. *£*lfTl**Att* SoTl^A*3!U BoTl* 

<*P^r-<;Kc^itr^->^aji srcgt^^tt^o 
[0017] >B»»i8i4. xmrnyT^ji^t^ 

fzgo*£fTbft£o £ ^— x 2 o it. nimu 

x) % 05*J£UX h^>©*>— >ICfcL^TI4iniJi-^^4- 
#SL^t^x s ^Tl*£AffctiI;£te#£L£: 



S^fcSoL>T. A*Lfc^"^^x>7 h*»<g*,Sfc£<?F 
[0 0 18] JtiH»2 2(4 % BfilLfc^— VfttfBtttt 

— >i=feit4A»(DfT»«H**taiLTa*-r*. frit 

[ o o 1 9 ] wi£&m%$ 1 2 . B*a$u 1 4 % >^sa 
t^yi^hf-^^-xi e-^KfllS-x— 

X2 0. fr!H s --*'<--X2 4I4«*tP— ^«»-?-f 

[0 0 2 0] «T. 12*0^1 4. ->->B*osn 8. it 

[002 1] <UX h7>Of- yM^-otzAtyrfm 

^^Lxi^zmmtf a frizzy ^<d&o *ii«*< 
htft**^i{? h£«tHLTB»»i 4fcet$&-r 

[0022] BZlZit. e^aJl 40^l7P-fV- 
hA^*tfCl^. HHftfflJlSlSI 2j!r>&»fflLfc 

it^i/x^ hGD^rYJU^A*! L (s i o 1 ) % jw*^- 
-JV-zlO hf-^^-X 1 6(zfBtt^ttTl>4*>t^^ 
v^x<7 htmt^^did^yAiit^yx^ h^ttft: 
^-^vx^7 h^J^ISiJt^ (S 1 0 2) 0 fLT, A^D 
^-^v^x^ h^Afe^^^x<7 h-efc^it^lzl^ P> 
f:Iit^yx^ h^(D$tftt^P>^(DAfei*<i:5l^^ 
»**T-prL^3&N**iJ®J-r* (S 1 0 3) 0 

J eOA«^^Tl^47^)^. 3loTl>£*^ f^Lt 
l>4^, 5-^t;l^Tl^4*^^-efe4 0 fit, A^^ 

i?x^HT?fe|i«^:lt *a>fftt«ttfc4:*fcAIB» 

Z>7<OUlZWitilb& (S104) 0 

[0023] -jj. \JiJr?i>ji0 btfMi&TfztVjLt 

x^7 htCDmiC^tJ^^-^^ (S 1 0 5) o mftftlZ 

^LT. ty&*Z?i/JLt hit. *<D%ftm&tt*>\Z® 
&my?"(Mz3it1sb& (S 1 0 6) o &L±(D£oizL 

tt^vx^h^ittra^^^t, 
>e»ja5i sfzai^t-^ cs i o ?) o 

[O O 2 4] H3|rf4. is— >Eftlffl1 8 (7)^7 D — 
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myr-oisZAJiTtzt (S20D % xfim^— ^ 

^ (S202) o H3(Zfi % M&mCD-mtffKZ tlTti 
fcKttX (O) % #SL*#fcl*ii£r;r!iG| (x) tftfs 

3tf>T?CX «#«^jfe4tl^fT«. X7-f Kl!*¥8li 
#£L*#fc^a>-Cx % «t©f*iI<D->— >7l2fl»B-pjfe 

4£l*5fr»k ^-<^<bl^ : 5^Tib^i?^^EL#^l^<7>-ex 
(O) ©BO*l^>->R»JiliJLtLK. 

vx^ hir^-t-r^C<tA<-e*. Xflfc*fl>->— >f*B 
[0 0 2 5] ttttLfc5>->fMta6<J|l-a)»*|ctt, * 

ot-yio-etx (O) A<fc4i/->A<a»#fit 

[0026] ^c-e. XftS£fflivcx«£¥iJSL/= 
a. >««£X (O) o>»<D*L^jiifcafe-<aiL* 

(S 2 0 3) 0 *lH»<&ii^ 5j-^^x^7 h<t LTHIIH 

^>CD*>->. £BX0>*>— titBr^ttOIHlcX 
(O) <DS*<*l>a>T? % 1. UXh7X 2. #B£ % 

[0 0 2 7] tLt, APalP^r-f^bAit^vx 

fT»*t*ct}&<aDy»*3Ei^g3&^fjS'r4 020 

4) o mi*. S 2 O 2-e«fflLfcv— LTUt 



2|Ztti*-r^> (S 2 0 5) 0 

[0 0 2 8] H4l=fi % «E$iaS2 2CD^S^P— — 
»L "T^^BftlLfrix— >fA*L (S3 0 1) % * 

ita-r^SA**-:^!* h<DtTi!iMi± cmmr-ci*. 

**£l*3frBBte) tA*LT, BttLfci'— 
l+«*OA1fca>ff»«B*Jt3B-r* (S3 0 2) 0 frM 

«Ho>itaiuci*. ftif-^^-x2 4(cifitt^tir^ 

BftLfc*>— VStfAM^yi^ h(0fr»iBttl::*S 

*-k> £«aj^-£ 0 tTis^r— <$"<— x^c: 

fT»«lcBJiWir»HStt-C^*}ta*--K^&, Btt 
Lfr>->WASlt^vi^ h<0fT»Bte£3l»£L 

£ e K + <Z>OI*-t0)«lfliA<#a-r-&Ci:S^L. x 
Kl^lcfcUtAit^yx^ h<DEiy^S«E-r*fSH*^ 
***<&S«*Mttff««B£LTiiB-r4 (S3 0 

3) o mz.it. m¥£^tzAmo>®<>)\zm*'jzsjLV h 
ri. iajnax. 2. &^dfTtt£Bfttt$ 

ti^W:t*«i*«o ^fr. **^Lfc Attain 

yicjm^-^^x^ h^y-a-t^vi^ htuv-h 
ri. ^it. 2. fcL^3frBXBfMI«W£L 

tJfi*Ltl>l) 0 fits ^LfctTiftSB^HSPlc 

ab^^r^ (s 3 o 4) 0 

[00 2 9] 'nrnmrncommmmt. *a*— K©*a 

tfft*B*-Kfcfclt*prttftffMBBO>*lc«#Lr 

x<b-r4<D^»BT?fc* 0 tx-t^ct^icLr. a^) 

B«A^6-ta>B«<D->— >RlfA®HDftmnm : £B9hto 

[0 0 3 0] <t7^X0 K70)«r-e«$»ofcA«83&< 
SSt *H«*<A* **Lfc»#> CCD cfe 5 fcU^A*) 
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So 

[0 0 3 1 ] S5ICli % >fgfcian 8<DiDr31^P — 

myj"0\,$:AtiTtz>t (S40D % xft$f- 

6 (S 4 0 2) 0 B5ICI*. ttrfc 
SizitK (O) . ff«L»3B:L^»*lcii« (x) 

tLTLN^o -pljptl^. XtDv— >Xlt. K7\ *9 

Lfct^vi^hOSMflSL, K (O) <D*0>*lx 
[0 0 3 2] tttBLfcS/— >«»*«m-(0»*|zl4 % * 

o v— >^|| £ t o r a -h w&<d v— >-e & & £ is^-r 
^yior^s (O) *<*-6v->A<]|»sat 

v->iiSS (O) <D%L<n§rim\z$i'<W7L& (S4 
0 3) 0 *!H£(£>if£\ LT K7*>*9 

BT(D\m\zM (O) 0)£&a<^l>tf)T. CCDIUlrimi 

[0033] fLr, AP B li¥^T-r;u^e,A^^vx 

fT»£i4c£*«fcy»5j&%g^£Wffi^4 (S4 0 

4) o mz.it. s 40 lt$s 

<t!2*Q-ra 0 *H«0>i§^ m±iiL<DJry>< xav>-> 

"T^ (S405) o 



[0034] Held*. !tfflSP2 2Ml7P-f-v- 
h*<^£;hTi^ 0 *r. :/B«»i 8frg»o>flt 
IS. -rft*>%E*PLfcS/— > {*y<<*) £A*jL (s 

5 0 1) . EftlgPl 4^bAlt^vi^ KO* 

(S 5 0 2) 0 ff»*H(Ditajlrli % fT»ir— ^K-X 
2 4^-f^1t$Hrt^^}«;l^-K^ffit^^o K 

fcMt£fE^3M^i%5*— K) *aajf^>o a 
tbLfc*— K^^lcfcl^rA^^v;x^ h(7)iH]y(c#^ 

(S 5 0 3) o «*tf* 1B****LfcA«l<Diay(r« 

^^a«"T^o Lf-AJ&KDlgjyir^;*- 
^vxy* I D*— Ft^vi^ htSSif-T. 

tLt, «SLfcfr»«H*n»l=Ui*-r* (S5 0 
4) o 

[0 0 3 5] <IlO^^:,_ t — |-^^A4^rl^^li 
Mttffi31ffii 2T*I*. Aftt^vi^ ht«5i*^^i?x 

* h£»ajLTfgsnsn 4ic«»-r^ c s^aaJi 4r* 
<<)i'ttot*myT'(MzftmTtz>o xyamy-r-oist l 

Tli. SotftjlLtl^Ai, ty&myT-t )l>t LT 
[ 0 O 3 6 ] 17 i>— >I2^D^ 1 8 <D5a^^ P — 

S¥^T-f ;u^A*-r^><t (S60i) . Sft$f-^^< 
^ (S 6 0 2) 0 @7iz(i. K««a>-fl35<**ixrfc 

^icfia (O) % #aL»<Fi^»*fztt« (x) ftttfd 

S(D > T'lijSfi 5 I * 5 frlS l*S2E L S -5 (D T 
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(O) coao^Lxv->^^«aiLr^< 0 
[0037] maiLtziy—>mmt<m-(om^\z[t, * 
<d v- M£is * 4> o r a ft m&o> is— >x- fc z> t B^-f 

«v o^yio-e^i (O) ^fc^v— iswrnrntt 

v— ><£li£X (O) <n$k(D§rim\~$L<<W7tz> (se 

k mm Mte&&tfm&£hz>±'*z>t. mm. 
mm. &m&<Dimizm (c» <Dm<&iwT*. clinic 

[oo3 8] fit, xmmyT-c j^i^x^ytyvjL 

ff»*t4Ci:A<fcy»ftAxS^$i|gjg-r5 (S6 0 
4) 0 S 6 0 2-ettthL/ci/— >feffit LT£ 

^£;6<fc6a<. A^* :?i>x^ hOltt^loT^I) 

(mm £<£-efc£if^ ff»ja-e(*ca>cfe3 35:ff«iii 
»« & y i vz> -e * £ £ mi*-r £ o 

CCD^IJ^Ii. S6 0 2TfflL^fcJlfll»*WflEffl^-Cff3 

t-e. i*fti:io©i/->saRLt (4Hk»o/t« 
*c:(*Sti±e<D*>— » il{i<Di>— >-rrfc££B*n-r 

Btt**tfc*>— jt?HSP2 2\z&jji-z> (se 

0 5) o 

[0 0 3 9] H8'(Zl* % ia»2 2(Dffll7P-f^- 

«L ?-&*>*B*nL*=v— > (MM) SA^iL (S7 0 
1) . Ba9l4^&A«t?vii?hlD^ff 

r. B»Lfc*>— ^icfccts-tcDAistDtTiiimHsaiaj 
r* (S702) 0 'nmmmcDmmizi^ irm^r-z* 

»ai-r^(7)3?)<»i@r*fc€> 0 fit, aaufc*— kwic 

OS*«MftfT«l*B<5:LT:ltai-r* (S 7 0 3) 0 ^ 

ffior*s«i#Lri^Atta)igyica— t— 



feSd*— Ka+frg rzj — t— (c^^A+tJ: 5 <!: L 
Tl**J tL\3*T»«B«Hi*a«!f «• lot 
tt£«»LTl*SAtta>E]y — t— 3f^*/x£ htf 

*i,£5<bLTl>£j *<»3E**t*ctlC3S:-B 0 fit, 
^SLfc^»itg|$nSPIcai^-rS (S7 0 4) 0 
[0 0 4O] BLL. **M0)S81fi^lBI=o^-clSMLfc 

iSfflLfc**. *fir#a>ff«j*H$eiliWlc«|iBILri 

*fc«*a>pr*tt*<fc«Ji^icttfttt«***Lfcy. 

ttJMME *fr 3 c i < A*fi0> ftltiSH $ flUBi? # « t 

L*3iMH£t*-r*. 

[0041] 

■«o>*i«-j-«i/->ft««»izanBBi-<?#. sac: 

[B9<DffiitL«:|fl9l] 

[@3] 11 fcfctt* v— >Bttffi<Dte37n— 

[14] hi icfcitsaiaiffloffija^p— ^-fr— h-e 
[is] ii ic£it«i/— >Btt0a>tta>a3a7D— 
[le] hi iz*5i+sflia(i«(Dffea>«ia^a— ^■v- 

[17] HI ICj3(t*i/— >B»»0>* t>ICf6<D^31 

[is] Hi izfeit«niiAa>$&fctta>as7n— 

[»^CDi5t^] 

1 o ttftfl*. i 2 MASS. 1 4 B^JSJ. 1 6 

^-^vx<7 hf-^^-X, 1 8 >BftlSP. 2 

0 IMf-^^-X, 2 2 ttfltf. 2 4^SH^~ 
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